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(54) information processing method 

(57) Main image infomiatton (101) representing a 
portrait face image of a person is prepared. Predeter- 
mined pattern image information (1 02), used as sub im- 
age information, is also prepared. Synthetic image in- 
f omiation (1 03) is prepared by synthesizing the main im- 
age infonmation (101 ) with the pattern image infomr^ation 



(1 02) in such a manner that the pattem image infomria- 
tion (102) is embedded in the main image information 
(1 01) in a state that is not recognizable to the eye of a 
human being. This synthetic image information (1 03) is 
recorded on an ID card (1 05) or the like as a visible Im- 
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Description 

[0001] The present invention relates to an Infonnation processing method for synthesizing main image information 
(which represents a portrait face image, for example) with sub image infonnation (which is additional information, such 

5 as security Infomiation) and recording resultant synthetic image on a recording medium. The information processing 
method is also for sensing the sub image infonnation from the recorded synthetic information. 
[0002] In recent years, the technology for electronic watemriark and signature is attracting more attention in accord- 
ance with the widespread computerization of infonnation and the wide use of the Internet, This kind of technology 
creates synthetic image information by synthesizing main and sub image infonnation. It Is effective in preparing an ID 

10 card on which a portrait face image is printed, and also effective in preventing making an illegal copy, forgery, and 
modification of a picture in which copyright infonnation is embedded. 

[0003] "How To Synthesize And Encode Text Data In Color Density Pattern," Journal Published by the Academic 
Image Electronics Society of Japan. 17-4(1 988), pp. 1 94-1 98. discloses a method for superimposing information on 
a digital Image represented In pseudo-gradation. 
15 [0004] Jpn. Pat. Appln. KOKAI Publication No. 9-248936 discloses a method for embedding a monochromatic binary 
image in a color image, using color sensitivity. 

[0005] Jpn. Pat. Appln. KOKAI Publication No. 6-1 01 90 discloses a method for preventing forgery and modification 
of an ID card. According to the reference, the ID card is overlaid with either a transparent film having a unique fine- 
line pattern or mesh pattern, or a lenticular film having a predetermined frequency. Since moir6 patterns generated 

20 then are different depending upon the films laid on the ID card, the forgery and modification are prevented. 

[0006] According to "How To Synthesize And Encode Text Data In Color Density Pattern," the sub image information 
embedded in synthetic image infonnation is reproduced for verification by reading the synthetic image infonnation by 
use of high-resolution read means and reproducing the sub image infonnation from the read image infonnation. Since 
the high-resolution road means (scanner) is required for reading the synthetic image fonnatlon, the verification is not 

25 easy. 

[0007] According to Jpn. Pat. Appln. KOKAI Publication No. 9-248935, the embedded sub image picture is repro- 
duced by laying a sheet-like mask on the synthetic image information with high accuracy. In this case, the sub image 
infonnation is reproduced by accurately positioning the sheet-like mask and the synthetic image information with ref- 
erence to each other. In other words, extremely high accuracy Is needed when the synthetic Image information is 
30 recorded and when the sub image information is reproduced. Since easy reproduction of the sub Image infonnation Is 
not enabled, easy verification Is not possible. 

[0008] According to Jpn. Pat. Appln. KOKAI Publication No. 6-10190, sub Image infonnation used for verification is 
prepared in a state where it can be visually perceived by a human being. This means that the storage position of the 
infonnation that Is essentially important to the verification may be easily known. Hence, the method of the reference 

35 is not reliable in terms of security. 

[0009] As described above, the conventional infonnation processing method has the problem that the easy verifica- 
tion based on the sub image information for security and the reliable security for verification are incompatible. 
[001 0] Accordingly, an object of the present invention is to provide an infonnation processing method which enables 
sub image infonnation to be synthesized with main Image Infonnation that is recognizable to the naked eye of a human 

40 being, in such a manner that the synthesis itself is executed in a state that is not recognizable to the naked eye of the 
human being, and which enables the sub image infonnation to be easily sensed in a simple way, thereby attaining 
easy verification based on the sub image information. 

[0011] The present invention provides an infonnation processing method comprising: a first step of preparing main 
Image infomnation that Is recognizable to the naked eye of a human being; a second step of preparing pattem image 

45 infonnation; a third step of executing color difference modulation processing for the pattern image infonnation prepared 
In the second step in accordance with a predetennined color difference modulation amount, and superimposing the 
pattern image infonnalion, which has been modulated in color difference by the color difference modulation processing, 
on the main image information prepared in the first step, thereby preparing synthetic Image information; and a fourth 
step of recording the synthetic image Information, prepared in the third step, on a recording medium as a visible Image. 

so [0012] The present invention also provides an information processing method comprising: a first step of preparing 
main image information that is recognizable to the naked eye of a human being; a second step of preparing a plurality 
of kinds of pattern image infonnation, which is defined by a repetition of a pattem image; a third step of preparing 
synthetic image information by synthesizing the pattern image infonnation prepared in the second step with a plurality 
of areas of the main image infonnation prepared In the first step, such that the synthesized state In which the plurality 

55 of pattern image infonnation are Integrated with the main image information is not recognizable to the naked eye of 
the human being; and a fourth step of recording the synthetic image infomnation, prepared in the third step, on a 
recording medium as a visible image. 

[0013] The present invention further provides an Image processing step comprising: a first step of preparing main 



2 

innin-<FP h.'wuta? i > 



EP 1 136 947 A2 

image information that is recognizable to the naked eye of a human being; a second step of preparing sub image 
information by preparing first pattern image information and second pattern image infomiation different from the first 
pattern image information, and by assigning the first and second pattern image information to the main image infor- 
mation such that the first pattern Image information is assigned to an area corresponding binary image information 

5 representing a character or a symbol and such that the second pattern image signal is assigned to a background area 
which is other than the area corresponding to the character or the symbol; a third step of preparing synthetic image 
infonnation by synthesizing the sub image information prepared in the second step with the main image information 
prepared in the first step, such that the synthesized state is not recognizable to the naked eye of the human being; 
and a fourth step of recording the synthetic image information, prepared in the third step, on a recording medium as 

10 a visible image. 

[001 4] This summary of the invention does not necessarily describe all necessary features so that the invention may 
also be a sub-combination of these described features. 

[001 5] The invention can be more fully understood from the following detailed description when taken in conjunction 
with the acconripanying drawings, in which: 

15 

FIG. 1 is a flowchart illustrating the overall flow of the Inf onrtation processing method according to the first embod- 
iment of the present invention. 

FIG. 2 Is a schematic diagram illustrating pattern Image infonrtation. 

FIG. 3 is a flowchart illustrating how synthesis processing takes place. 
20 FIG. 4 shows red components of main image infonnation. 

FIG. 5 is green components of the main image Information. 

FIG. 6 illustrates pattern image information. 

FIG. 7 shows an example of a result of color difference modulation. 

FIG. 8 shows red components of a result of superimposition processing. 
25 FIG. 9 shows green components of a result of superimposition processing. 

FIG. 10 is a schematic diagram illustrating an example of a synthetic image. 

FIG. 11 is a schematic diagram illustrating an example of verification processing. 

FIG. 12 is also a schematic diagram illustrating an example of verification processing. 
^ FIG. 1 3 is a schematic view of first pattern image information according to the second embodiment of the present 

30 invention. 

FIG. 14 is a schematb view of second pattern image infomnation according to the second embodiment of the 
present invention. 

FIG. 15 illustrates an example of a manner in which main image infomnation is divided. 

FIG. 16 illustrates how the divided main image infonnation is synthesized with the first and second pattern image 
35 infonnation. 

FIG. 17 illustrates red components of main image Information. 

FIG. 18 illustrates green components of the main image information. 

FIG. 1 9 shows an example of first pattern image infomnation. 

FIG. 20 shows an example of second pattern Image infonnation. 
40 FIG. 21 is a schematic diagram illustrating a synthetic image. 

FIG. 22 is a schematic diagram illustrating a first example of verification processing. 

FIG. 23 is also a schematic diagram illustrating a first example of verification processing. 

FIG. 24 is a schematic diagram illustrating a second example of verification processing. 

FIG. 25 is also a schematic diagram illustrating a second example of verification processing. 
45 FIG. 26 is a schematic diagram illustrating how verification processing is executed. 

FIG. 27 illustrates sub image information according to the third embodiment of the present invention. 

FIG. 28 is a flowchart illustrating how image synthesis processing is executed on the basis of binary image infor- 
mation. 

50 [0016] Embodiments of the present invention will now be described with reference to the accompanying drawings. 
[0017] First, the first embodiment will be described. 

[0018] FIG. 1 is a flowchart illustrating the overall flow of the information processing method according to the first 
embodiment of the present invention. The overall flow of the infonnation processing method will be described, referring 

to this flowchart. 

55 [0019] In FIG. 1 , main image information 101 is a portrait face image used for identification. The main image infor- 
mation 101 is comprised of digital data. It is prepared by reading a photographed portrait face image by scanner input 
processing 106 or by photographing a person's face by camera photographing processing 107. 
[0020] Pattern image Information 102. which is sub image information, is prepared either by pattem image input 



JDCX:iD: <EP 11 36947 A2_L> 



EP1 136 947 A2 



10 



IS 



20 



2S 



30 



35 



40 



SO 



55 



processing 108 or by pattern image preparation processing 109, The pattern image input processing 1 08 is executed 
when a pattern image is externally input. The pattern image preparation processing 109 is executed when a pattern 
image is prepared on the basis of a predetemnined pattern. In the first embodiment, the pattern image information 102 
is in the fomri of a pattern, wherein the unit size is a rectangle of 4 pixels (horizontal) x 2 pixels (vertical) and which is 
expressed as a cyclic pattern of black and white rectangles. 

[0021] By synthesis processing 110, the main image information 101 and the pattern image information 102 are 
synthesized to obtain synthetic Image infomiation 103. In the synthetic image information 103, the pattern image in- 
formation 102 is embedded in the main image information 101 in a state that cannot be recognized to the naked eye 
of a human being. The details of the synthesis processing 110 will be described later 

[0022] By printing processing 111, a synthetic image 104 based on the synthetic image infomiation 103 is printed 
on an ID card 105. An image fomriing apparatus, such as a dye-sublimation type thennal transfer printer, is used for 
the printing processing 111. This image fonning apparatus prints (records) the image based on the synthetic image 
inlomnation at a face image print position on the ID card 105. which is a recording medium. The synthetic image 104 
printed on the ID card 105 by the print processing 111 is used as a face image for identification. To the naked eye of 
a human being, the synthetic image 104 looks as If it were the same as the image information 1 01 . 
[0023] The ID card 105 prepared in this manner can be subjected to verification processing 112 to determine if it is 
authentic. Let it be assumed that a sheet-like mask (hereinatter referred to as a mask sheet) 113 is prepared by mask 
preparation processing 1 1 5. The mask sheet 1 1 3 has the same pattern of light transmission factor as the pattern Image 
tnlormalion 102. The mask sheet 113 is laid on the synthetic image 104 of the ID card 106. and is moved relative to 
the synlheUc image 104. The relative movement between the mask sheet 113 and the synthetic image 104 is either 
linear movement or rotation. In the case of the linear movement, it is either vertical or horizontal. In the case of the 
rotation, one of the mask sheet 113 and the synthetic image 104 is fixed, and the other is rotated. 
[0024] If the ID card is authentic, the relative movement between the mask sheet 113 and the synthetic image 104 
produces moire fringes, the principle of which will be describe later In other words, if those moir6 fringes are produced, 
it can be determined that the ID card 105 is authentic. If the relative movement between the mask sheet 113 and the 
synthetic image 1 04 does not produce any moird fringes, then it can be detemiined that that the I D card 1 05 is a forged 
one 



[0025] A description will be given as to how to prepare the pattem Image information 1 02. The pattem image infor- 
mation 1 02 is specifically a grid pattern of predetemnined cycles. As shown in FIG. 2, the pattern image information of 
the first embodiment is comprised of rectangular black patterns 201 and rectangular white patterns 202. These rec- 
tangular pattems, each of which is made up of 4 pixels (horizontal) x 2 pixels (vertical), are arranged in a cyclic pattern. 
(The period of the cyclic pattern of the grid corresponds to 8 pixels in the horizontal direction, and to 4 pixels in the 
vertical direction.) The vertical size and the horizontal size of the pattem image infomiation are relative dimensions, 
and the horizontal size need not be greater than the vertical size. 

[0026] The horizontal pixel size and vertical pixel size of the grid are required to satisfy the following ratio: 



a/b > 1 



where a is a larger number between the horizontal size and the vertical size of the grid of the pattern image information, 
b is a smaller number between them. Preferably, the ratio a/b is in the range of 2 to 8. 
[0027] The synthesis processing 110 will be described with reference to FIGS. 3 through 8. 
[0028] The main Image information 101 (101 R, 101G. 1018) is image infomnation on a natural image, such as a face 
image for identification. The main image infomiation 101 Is assumed to contain 24-bit Information per pixel (8 bits for 
"fs each of "R", "G" and "B", in the range of 0 to 255). 

[0029] FIGS. 4 and 5 show an example of the main Image Infomriatton 101 . For simplicity, let us assume that the 
main image information 101 is uniformly gray, as represented by (R. G, B) = (127. 127, 127), and is partly cut out to 
have a size of 1 2 x 1 2 pixels. FIG. 4 shows the red components 1 01 R of the main image infomiation 1 01 , and FIG. 5 
shows the green components 1 01 G thereof. Illustration of the blue components is omitted. 

[0030] FIG. 6 shows an example of the pattern Image infomnation 102. The pattem image Information 1 02 is made 
of a grid pattern of regular cycles. The pattem image information 102 is embedded in the main image Information 1 01 
in a state that is not recognizable to the naked eye of a human being. The pattem image information 1 02 contains 1 -bit 
infomnation per pixel (in the range of 0 to 255). 

[0031] Lil<e the main image infomnation 101 , the pattern Image infomnation 102 is assumed to be partly cut out to 
have a size of 1 2 x 1 2 pixels, as shown in FIG. 6. The pattern image information 1 02 is a grid pattem wherein the unit 
size is a rectangle of 4 pixels (horizontal) x 2 pixels (vertical) and which is expressed as a cyclic pattern of black and 
white rectangles. In the pattern image Infomnation 1 02, the black color is indicated by "1", and the white color is indicated 
by "0." 
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[0032] First of all, color difference modulation processing step 301 is executed. In this step, the pattern image Infor- 
mation 102 is subjected to color difference modulation processing, using the rules expressed by formulas (a-1) and 
(a-2) set forth below. By this processing, the color difference modulation processing step 301 creates color difference 
modulation pattern image information. According to the color difference modulation processing step 301, black and 
white pixels are assigned in accordance with the values of the pixels of the pattern image information 102 In such a 
manner that a back pixel Is assigned to "+1 " and a white pixel to "-1 ." Each of the values is multiplied by a color difference 
modulation amount AV. This color difference nK>dulation amount AV is in the range of 0 to 255 and is determined 
beforehand. In the color difference modulation processing step 301 . this processing Is executed for each pattern image 
Infonnation 102. FIG. 7 shows an example of a result of color difference modulation 102'. 

CDMP(i,j) = (+1)^AV when PAT(i,j)= (black) (a-1) 



15 



CDIV^P(i,j) = (-1)*AV when PAT(i,j)= (white) (a.2) 



where CDI\/IP(l,j) represents the value the color difference modulation pattern Image information takes at the position 
indicated by (x=i, y=j), PAT(l,j) represents the value the pattern Image information takes at the position indicated by 
(x=i, y=j), and Av represents a color difference modulation amount. 

20 [0033] The color difference modulation amount AV is an integer in the range of 0 to 255 ad is determined beforehand. 
The larger the color difference modulation amount Av is, the higher will be the visualization contrast at the time of 
verification. In this case, the verification is easy, but the synthetic Image Information is liable for adverse effects and 
may result in poor image quality. Hence, it is desirable that the color difference modulation amount AV be within the 
range of 1 6 to 96. In the present embodiment, AV = 48. 

25 [0034] In a superimposltion processing step 302 subsequently executed, the color difference modulation pattern 
image infonnation obtained In the processing described above is synthesized with the main image information 101 
prepared beforehand, so as to obtain synthetic image information 103 (103R, 103G, 103b). In the superimposltion 
processing step 302, superimposltion processing indicated by the fonnulas (b-1) to (b-3) set forth below is executed. 

30 

DES-R{i,j) = SRC-R(IJ) + CDMP(i.J) (b-1) 

k 

DES-G(i,j) = SRC-G(I j) - CDMP(i,j) (b.2) 

35 

DES-B(i.j) = SRC-B(i,j) - CDMP(i.j) (b-3) 

where DES-R(i,j) represents the value the synthetic image information takes at the position indicated by (x=i, y=j) (red 
40 components), DES-G(i,j) represents the value the synthetic image infonnation takes at the position indicated by (x=i, 
y=j)(green components), DES-B(l,j) represents the value the synthetic image infomiatlon takes at the position indicated 
by (x=i, y=j) (blue components), SRC-R(i.j) represents the value the main image information takes at the position 
indicated by (x=i, y=j) (red components), SRC-G(i,j) represents the value the main image information takes at the 
position Indicated by (x=l, y=j) (green components), and SRC-B(I,j) represents the value the main image infonnation 
45 takes at the position Indicated by (x=i, y=j) (blue components). 

[0035] DES-R(i,j), DES-G(i.j) and DES-B(i,j) are integers in the range of 0 to 255. That is. if a result of calculation is 
less than "0", It is set to be "0", and if it is greater than "255**, it is set to be "255." 

[0036] FIGS. 8 and 9 show results of superimposition processing. FIG. 8 Indicates the case of red components, and 
FIG. 9 indicates the case of green components. 
so [0037] As can been seen from fonnulas (a-1 ) and (a-2), the coefficient for the color difference modulation amount 
AV alternately takes the values of "+1 " and "-1 " in accordance with the cycle of the pattern image infomiatlon 1 02. If 
integration is carried out with respect to one cycle of the pattern image infonnation 1 02, the values of the color difference 
modulation amount cancel each other, and the result of integration is thereby rendered zero. Hence, the following 
formulas are satisfied with respect to the cycles of the grid of the pattern image Information 102. 
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2:DES.R(i.j) = ISRG-R(i,j) (c-l) 
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IDES.G(i j) = ISRC-G(iJ) (C.2) 

LDES.B(iJ)=2:SRC-B(ij) (c-3) 

[0038] These formulas (c-1) to (c-3) are satisfied for each area of the image. Hence, the overall atmosphere of the 
main image information 101 remains unchanged even after the main image information is integrated in the synthetic 
image infomnation 1 03. 

[0039] The average of the data values of the 12 x 12 pixels shown in FIGS. 8 and 9 is "127." As can be seen from 
this, the statistic value (average value) of the data values of the main image inf onnation is stored. The image information 
subjected to superimposltion processing (namely, the synthetic image infomiation) may be different from the main 
image information if attention is paid to the data value of each individual pixel. From a macroscopic viewpoint, however 
it is hard to distinguish between the synthetic image infomnation and the main image Information. The statistic values 
of the main image infomiation, such as the average value, are preserved. This being so, the synthetic image information 
and the main image information look like the same from a macroscopic viewpoint, e.g.. when they are looked at on the 
basis of a size of 12 x 12 pixels. 

[0040] As can be seen from formulas (a-1 ) and (a-2). the coefficient for the color difference modulation amount AV 
allernalely lakes ihe values of "+1 " and "-1 " in accordance with the cycle of the pattern Image Information 1 02. It should 
be noted that the signs of the coefficients of the green and blue components are the same, but the signs of the coefficient 
of the red components differ from them. This is to make use of the complementary-color relationship. In the first em- 
bodiment, red and cyan colors are used as complementary. When the sign of the red components Is positive (+), the 
signs of the complementary colors, namely, the green and blue colors, are set to be negative (-). Conversely, when 
the sign of the red components is negative (-). the signs of the complementary colors, the green and blue colors are 
25 set to be positive (+). 

[0041] In this manner, when the signs of fomiulas (a-1) and (a-2) are determined, the value of the pattern Image 
information 102 is set to be that of "black" or "white." When the value of the pattem image information 102 is that of 
"black", the values of the synthetic image infomiation 103 are determined in such a manner that "red" is emphasized 
When the value of the pattem image infomiation 1 02 is that of "white", the values of the synthetfc Image information 
103 are detennined in such a manner that "cyan" is emphasized. In the synthetic image information 103 therefore 
red-and cyan-color grid components are embedded at positions corresponding to the grid cycles of the pattern imaqe 
infomiation 102. 

[0042] In FIG. 8. pixels whose data value is 175 emphasize "red", while pixels whose data value is 79 emphasize 

"cyan." 
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[0043] In those pixels that have many "red" components, a few "green" and "blue" components are present Con- 
versely. in those pixels that have a few "red" components, many "green" and "blue" components are present Since 
the red color and the cyan colors (i.e.. the green and blue colors) are complementary, It is hard to make a distinction 
between red and cyan colors when these colors are adjacent. To the eye of a human being, they look as if they were 
colorless. In the example shown in FIG. 8, the pixels that are rich in red color and the pixels that are rich in cyan color 
are repeatedly arranged In a cyclic pattem con-esponding to the grid's cyclic pattem of the pattem image information 
102. This means that the pixels that emphasize the red color (i.e.. the pixels whose data value Is 175) and the pixels 
that emphasize the cyan color (i.e., the pixels whose data value is 79) are arranged in regular cycles When the pixel 
density is high, the slight differences between the red color and the cyan colors (complementary colors) are hard to 
perceive to the eye of a human being. To the human eye. the color differences are "0." 

[0044] As can be seen from the above, a human being perceives the synthetic Image Information and the main Image 
infonmaiion as being identical, and therefore does not notice that an image that has been embedded. 

(Synthetic Image Information) = (Main Image Information) (d) 

50 [0045] On the basis of the principles described above, it Is possible to prepare synthetic image information 103 
wherein pattem image information 102 is embedded in main image information 1 01 in a state that is not recognizable 
By pnnting or recording the above synthetic image infomiation 103 by a high-resolution printer (e.g., a 300 dpi dye- 
sublimation type thermal transfer printer), it is hard, or impossible, for the human eye to make a distinction between 
the synthetic image infomnation and the main image information. 

55 [0046] The synthetic image infomnation 103 looks the same as ordinary image information, and image formats for 
general-purpose use (such as JPEG and TIFF) can be adopted. In addition, the synthetic image information 103 can 
be processed using an application that is adapted to process general types of Image information. Accordingly the 
system required can be realized with ease. Even if the synthetic image Information is converted into another image 
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format, the embedded pattern Image information 1 02 remains the same, and the conversion does not give rise to any 
problems. 

[0047] The synthetic image information 103 is printed or recorded by a high -resolution color printer (e.g.. a dye- 
sublimation type thermal transfer printer), and the resultant information is pasted on an ID card or the lil<e. Therefore, 

5 a system that determines whether or not the ID card 1 05 is authentic, checks the information embedded in the synthetic 
image Information 1 03 pasted on the ID card 1 05, and detemnines whether or not the ID card 1 05 is authentic on the 
basts of the check. In other words, the pattern image infonmation 102, which is sub image information invisibly embed- 
ded in the verification-use face Image of the ID card, is sensed to detemnine whether or not the ID card 1 05 is authentic. 
[0048] The pattern image information 102, which is the sub image information, is sensed by use of the mask sheet 

10 113, and this mask sheet 113 is prepared on the basis of the pattern image infomnation shown in FIG. 6. In terms of 
the pixel size or pixel position, the mask sheet 113 corresponds to the main image infonnation 1 01 with a 1 :1 relation- 
ship. The pattern image infonmation 102 is made up of black patterns and transparent patterns. The black patterns 
have a value of "1" and do not allow transmission of light, while the transparent patterns have a value of "0" and allow 
transmission of light. The mask sheet 113 is physically laid over the synthetic image 104 printed on the ID card. 

75 [0049] FIG. 1 0 is a schematic diagram illustrating the synthetic image 1 04 in the printed state. Where the synthetic 
image 1 04 is prepared on the basis of "unifonnly-gray" main image inf omriation 1 01 , red and cyan cyclic panerns are 
embedded as grid patterns. In FIG. 10, the pixels Indicated by "R" are pixels that are rich In red, while the pixels 
indicated by "C" are pixels that are rich in cyan. 

[0050] FIGS. 11 and 12 schematically show how the synthetic image 104 shown in FIG. 10 will be when it is overiaid 
20 with the mask sheet 113 described above. FIG. 11 showsthecase where the synthetic image 104 and the mask sheet 
113 are positioned accurately relative to each other. FIG. 12 shows the case where the synthetic image 104 and the 
mask sheet 113 are shifted from each other by a half period of the cyclic grid pattern. In FIGS. 11 and 12, the pixels 
indicated with hatchings are those pixels that are masked by the mask sheet 113. 

[0051] In FIG. 11 , the pixels indicated by letter "R" are masked, and the pixels indicated by letter "C" are observable 
25 as being transparent. In this state, therefore, the grid looks like a cyan grid partly covered with a black mask. In FIG. 
12, the pixels indicated by letter "C" are masked, and the pixels indicated by letter "R" are observable as being trans- 
parent. In this state, therefore, the grid looks like a red grid partly covered with a black mask. 

[0052] When the printed synthetic image 104 overlaid with the mask sheet 113 is viewed, what will be observed is 
the state shown in FIG. 1 1 , the state shown in FIG. 1 2, or the state intermediate between those shown in FIGS. 1 1 and 
30 12. When the printed synthetic image 104 is fixed, and the mask sheet 113 is moved vertically or horizontally relative 
thereto, the states shown in FIGS. 11 and 12 are observed alternately. In other words, the cyan and red grids partly 
covered with the black mask are altemately observed. Hence, whether the synthetic image 1 04 is authentic or not can 
be determined by checking whether or not the red and cyan grids are alternately observed when the mask sheet is 
moved. 

35 [0053] The relative movement between the printed synthetic image 1 04 and the mask sheet 1 1 3 need not be con- 
trolled precisely. Instead of the vertical or horizontal movement described above, a rotational movement may be used. 
In this case, moire fringes are observed due to the slight shift between the black grid of the mask sheet 113 and the 
red or cyan grid which Is partly covered. The authenticity detemnination can be made on the basis of the presence of 
such moire fringes. 

40 [0054] A description will now be given of the second embodiment, 

[0055] In the second embodiment, the pattern image infonnation 1 02 serving as sub image infonnation is made by 
a plurality of pieces (N pieces). Reference will be made to the case where N = 2. 

[0056] FIGS. 13 and 14 show two kinds of pattern image infonnation. The first pattern image infomnation 102a is 
similar to the pattern image infomnation 102 of the first embodiment. The second pattern Image information 102b is 

45 prepared by rotating the first pattern Image information 1 02a 90 in the clockwise direction. 

[0057] Although the case where N = 2 will be referred to in connection with the second embodiment, the number of 
pieces of pattern image infonnation 102 may be determined arbitrarily. That is, pattern image information that is used 
as a reference is first prepared beforehand, and then other pieces of pattern image information are prepared by rotating 
the reference pattern image information by different angles. For example, in the case where N = 3, second and third 

50 pieces of pattern image infonnation are prepared by rotating the reference pattern image information 40* and 90*, 
respectively. 

[0058] Next, preparations for synthesis processing 110 are made. As shown in FIGS. 15 and 16, the main image 
infonnation 101 is divided into N pieces. The manner in which it is divided is optional. In the second embodiment, the 
main image infonnation 101 is divided into equal pieces, namely, area A (the left half) and area B (the right half). The 
55 two pieces 1 02a and 102b of pattern image information are assigned to these two areas A and B. As shown in FIG. 
1 6, the first pattern image information 1 02a is associated with area A, and the second pattern Image information 1 02b 
is associated with area B. 

[0059] In the synthesis processing 1 1 0, the same method as described in connection with the first embodiment can 
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be used without any modification. That is, first synthetic innage infonnation is prepared by synthesizing the first pattern 
image Information 1 02a with area A of the main image information 101 . Lil<ewise, second synthetic image infonnation 
is prepared by synthesizing the second pattern image infonnation 1 02b with area B of the main image infonnation 1 01 . 
By simply combining these two pieces of synthetic Image infonnation. the resultant synthetic image contains two kinds 
5 of pattern image infonnation. The synthetic image, prepared in this manner, is printed out by a high-resolution color 
printer, so that it can be used as an identification image of an ID card. 

[0060] An example of the main image infonnation 101 used in the second embodiment is shown In FIGS. 17 and 18. 
As in the first embodiment, the main image information 101 of the second embodiment is assumed to be uniformly 
gray, represented by (R. G. B) = (127, 127, 127), and partly cut out to have a size of 12 x 12 pixels. FIG. 17 illustrates 
10 red components of the main Image information 101 . and FIG. 18 illustrates green components thereof. Illustration of 
blue components Is omitted. 

[0061] In FIGS. 17 and 18, the area defined by coordinates x = 0 to 5 constitutes area A, and the area defined by 
coordinates x = 6 to 1 1 constitutes area B. The one-dot-chain line indicates the border between these two areas A and B. 
[0062] FIGS. 19 and 20 show examples of pattem image information 102a and 202b, respectively 

IS [0063] FIG. 20 shows examples of pattern image Infonnation 102a and 102b. The first pattern Image information 
102a in FIG. 19 uses a pattern similar to that of the pattem image infonnation 102 of the first embodiment, and Is partly 
cut out to have a size of 6 x 12 pixels. The second pattern image information 102b in FIG. 20 Is obtained by first 
rotating the pattern image infonnation 1 02 of the first embodiment 90* in the clockwise direction and then partly cutting 
out to have a size of 6 x 12 pixels. 

20 [0064] As described above, the area-A portion of the main image information 1 01 is synthesized with the first pattern 
image infonnation 102a in a similar method to that described in connection with the first embodiment. Likewise, the 
area-B portion of the main image infonnation 101 is synthesized with the second pattern image information 102b in a 
similar method to that described in connection with the first embodiment. The results of these synthetic operations are 
merely combined together to obtain synthetic Image Information. A schematic diagram illustrating the resultant synthetic 
image is shown in FIG. 21 . In FIG. 21 , the pixels indicated by letter "R" are pixels that are rich in red. and the pixels 
Indicated by letter "C" are pixels that are rich in cyan. 

[0065] For authenticity detemriination, a first mask sheet 113a is prepared beforehand from the first pattern image 
infonnation 102a. The mask sheet 113a is laid on the printed synthetic image 104, as in the first embodiment. The 
states in which the first mask sheet 113 is laid are schematically Illustrated In FIGS. 22, 23. 24 and 25. 
30 [0066] FIG. 22 shows the case where the synthetic image 1 04 and the mask sheet 113a are positioned accurately 
relative to each other. FIG. 23 shows the case where the synthetic image 1 04 and the mask sheet 1 1 3 are shifted from 
each other by a half period of the cyclic grid pattern. In FIGS. 22 and 23. the pixels indicated with hatchings are those 
pixels that are masked by the mask sheet 11 3a. 

[0067] FIG. 24 shows the case where the synthetic Image 1 04 and the 90'-rotated mask sheet 1 1 3a are positioned 
35 accurately relative to each other. FIG. 25 shows the case where the synthetic image 1 04 and the 90*-rotated mask 
sheet 113a are shifted from each other by a half period of the cyclic grid pattern. In FIGS. 24 and 25, the pixels indicated 
with hatchings are those pixels that are masked by the mask sheet 113a. 

[0068] Referring to FIG. 22, in area A and on part of the border between areas A and B, only the pixels Indicated by 
letter "C" are obsen/ed as being transparent. On the other hand, in area B, both the pixels indicated by letter "R" and 
40 the pixels indicated by letter "C are observed. In other words, red and cyan colors observed in the mixed state. Since 
these two colors (red and cyan colors) are complementary to each other, it is hard to distinguish between them to the 
naked eye of a human being as long as the pixels are printed at a density as high as 300 dpi. in this state, therefore, 
the cyan grid is observed between the black masks in area A, and what is seen in area B is blurred and no image is 
observed. 

45 [0069] Referring to FIG. 23, in area A and on part of the border between areas A and B, only the pixels Indicated by 
letter "R" are observed as being transparent. On the other hand, In area B. both the pixels indicated by letter "R" and 
the pixels Indicated by letter "C" are observed in the mixed stale. In this state, therefore, the red grid is observed 
between the black masks in area A, and what is seen in area B is blurred and no image Is observed. 
[0070] When the printed synthetic image 1 04 overlaid with the mask sheet 1 1 3a is viewed, what will be observed is 

50 the state shown in FIG. 22, the state shown in FIG. 23, or the state intermediate between those shown in FIGS. 22 
and 23. When the printed synthetic image 104 is fixed, and the mask sheet 113a is moved vertically or horizontally 
relative thereto, the states shown in FIGS. 22 and 23 are observed alternately In other words, in only area A, the cyan 
and red grids partly covered with the black mask are alternately observed. In area B, the image is blurred, and no clear 
pattem is observed. 

55 [0071] FIG. 26 is a schematic diagram illustrating how verification processing is executed. When the mask sheet 
113a is moved relative to the synthetic image, the red and cyan grids alternately appear in area A only. Alternatively 
moird fringes are generated, and changes are thereby produced in the image that is being perceived. On the basis of 
the presence or absence of such changes, it is possible to detennine whether or not the synthetic image 1 04 is authentic. 
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[0072] A description will now be given of the third embodiment. 

[0073] The third embodiment employs first and second pattern image information 102a and 102b that are similar to 
those described above in connection with the second embodiment. According to the third embodiment, an area is 
divided on the basis of the image infomnation (binary image information) representing the binary values (black and 

5 white) of characters or symbols, and the first and second pattem image information 102a and 1 02b are applied to the 
divisions of the area. As in the first and second embodiments, the main image Information 101 may be a photographic 
natural image, such as a landscape or a face Image for Identification. The binary Image information may be prepared 
beforehand; altematively, it may be externally provided when synthetic image infomnatlon is to be prepared. 
[0074] FIG. 27 illustrates an example of a manner in which the first and second pattern image information 1 02a ad 

10 102b are applied to binary image infomnation 400. which is divided into small areas. In the example shown In FIG. 27. 
the first and second pattem image Information 102a and 102b are applied to Images (410 to 419) of numerals "0" to 
"9" and images (41 A to 41 F) of alphabetic characters "A" to "F." The image Information serving as the binary image 
infomnation has the same size as an area to be embedded. For example, when numeral "0" Is to be embedded in the 
entire image information, the binary image infomnation representing numeral "0" is first processed in such a manner 

15 that it has the same size as the main image information, and then synthesis processing is executed. When binary 
image Infonmation representing a plurality of numerals or symbols is embedded In a partial area of the main image of 
the binary Image infomnation, the binary image Information Is magnified In such a manner that it Is the same in size as 
the embedding area, and then synthesis processing Is executed. 

[0075] A description will be given with reference to the flowchart shown In FIG. 28. as to how the image synthesis 

20 processing is executed on the basis of binary image information. 

[0076] First of all, the binary image information Is divided to have desirable dimensions (1 x m) (Step SI). In the 
example shown in FIG. 27, 1 = 5 and m = 7. The small areas of the divided binary image information are classified by 
checlcing whether they correspond to a character or symbol portion or If they correspond to a background portion, 
which Is other than the character or symbol portion (Step S2). Either the first pattern image Infomnation 102a or the 

25 second pattern image information 1 02b is assigned to each of the small areas (Step S3). For example, the first pattern 
image Infomnation 102a is assigned to the background portion, which Is other than the character or symbol, and the 
second pattem image information 102b is assigned to the character or symbol portion (the non-background portion). 
[0077] After either the first pattem image information 102a or the second pattern image infonmation 102b is assigned, 
each small area is subjected to the synthesis processing described in connection with the first embodiment (Step S4). 

30 By executing synthesis processing for each small area, synthetic image infomnation corresponding to each small area 
is prepared. All of the resultant synthetb Image Information corresponding to the respective small areas are merely 
'combined (Step S5). 

[0078] By this combination, the synthetic image Information, which con^espond to the respective small areas, con- 
stitute an image having the original size (I.e., the size of the embedding area of the main image infomnation). The 
35 synthetic image information of the original size is printed on a recording medium by using a high-resolution dye-sub- 
limation type thermal transfer printer, for example (Step 86). In this manner, an ID card bearing the printed synthetic 
image infomnation is prepared. 

[0079] The synthetic image inforhnation prepared according to the third embodiment can be checked for authenticity 
by using the mask sheet 113a based on the first pattem image infomnation 102a in a similar manner to that of the 
40 second embodiment. To be more specific, a mask sheet 113a is prepared beforehand from the first pattem image 
infonmation 1 02a. The mask sheet 1 1 3a is laid on a synthetic image 1 04, which is a printed form of the synthetic Image 
information. The printed synthetic image 104 and the mask sheet 113a are moved relative to each other, in such a 
manner that the relative movement Is either linear movement (vertical or horizontal movement) or rotation. After this 
relative movement, the synthetic image 104 has a contrast between the portions where the first pattern image infor- 
ms mation 102a is embedded and the portions where the second pattern Image infonnation 102b is embedded. The con- 
trast Is produced due to the principle described above in connection with the second embodiment. It should be noted 
that the portions where the second pattern image infomnation 1 02b is embedded correspond to the background portions 
of the characters and symbols of the sub image information and that the portions where the first pattern image infor- 
mation 102a is embedded correspond to the non-background portions (i.e., the characters and symbols themselves). 
so Hence, the characters and background of the sub image information are indicated in the synthetic image, with a contrast 
being produced. 

[0080] As can be seen from the above, an authenticity detemnination can be madeby checking whether the embedded 
sub image information can be visually perceived. According to the third embodiment, moreover, characters or symbols 
can be embedded in a state that cannot be recognized to the eye of a human being, and the characters, symbols or 
55 other embedded information can be sensed in a simple and easy method. 

[0081] The infonnation processing method described above enables Issuance of an ID card bearing a face image 
which is for identification use and which provides a high degree of security. Since the information used for authenticity 
detemnination is embedded in a state that cannot be recognized to the naked eye of a human being, the main image 
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information is allowed to maintain its high quality. Furthemriore, an authenticity detemiination can be easily made with 
no need to employ a complicated machine. 



5 Claims 

1 . An information processing method characterized by comprising: 

a first step (106. 107) of preparing main image information (101) that is recognizable to the naked eye of a 
^0 human being; 

a second step (108, 1 09) of preparing pattern image infomnation (102); 

a third step (1 1 0) of executing color difference modulation processing (301 ) for the pattern image information 
(1 02) prepared in the second step (1 08. 1 09) in accordance with a predetemnined color difference modulation 
amount (32), and superimposing the pattern image infomnation (102), which has been modulated In color 
difference by the color difference modulation processing (301 ), on the main image Information (1 01) prepared 
in the first step (106. 107), thereby preparing synthetic image infomnation (103); and 
a fourth step (111) of recording the synthetic Image Infomnation (103), prepared In the third step (110). on a 
recording medium (105) as a visible image. 



20 



2. An information processing method according to claim 1 , characterized in that the pattern image information pre- 
pared (102) in the second step (108, 109) has a cyclic grid pattern having a predetennined period. 



3. An infomnation processing method according to claim 1 , ciiaraeterized in that said third step (110) executes color 
diffcronce modulation processing (301) such that a first color alternates with a second color complementary thereto, 
25 based on the pattern image infomnation (102) prepared in the second step (108, 109), and superimposes the 

pattem image information (102), which has been modulated in color difference by the color difference modulation 
processing (301), on the main image infomnation (101) prepared in the first step (106, 107). thereby preparing 
synthetic image infonnation (103). 

50 4. An infomnation processing method characterized by comprising: 

a first step (106. 107) of preparing main image information (101) that Is recognizable to the naked eye of a 

human being; 

a second step (108, 109) of preparing a plurality of kinds of pattern image infomnation (102a, 102b), which Is 
55 defined by a repetition of a pattem image; 

a third step (1 1 0) of preparing synthetic image infomiation (1 03) by synthesizing the pattern image Infonnation 
(102a, 102b) prepared in the second step (108, 109) with a plurality of areas of the main image infonnation 
(101) prepared in the first step (1 06, 1 07), such that a synthesized state is not recognizable to the naked eye 
of the human being; and 

a fourth step (111) of recording the synthetic Image infonnation (103), prepared in the third step (110), on a 
recording medium as a visible image. 

5. An information processing method according to claim 4, characterized in that said second step (108, 109) pre- 
pares a plurality of kinds of pattern image infomnation (102a, 102b). said plurality of kinds of pattern image infor- 
matlon (1 02a, 1 02b) Include first pattern image Information (1 02a) used as a reference, and other pattern image 
Infomnation (1 02b) obtained by rotating the first pattern Image Information (1 02a) by a predetemnined angle. 

6. An image infonnation processing according to claim 4, characterized in that said second step (1 08. 1 09) prepares 
first pattern image information (1 02a) and second pattern Image infonnation (1 02b), and said second pattern image 

so infonnation (102b) is obtained by rotating the first pattem image infomnation {102a) by 90*. 

7. An image processing step characterized by comprising: 

a first step (106, 107) of preparing main image infomnation (101) that is recognizable to the naked eye of a 
55 human being; 

a second step (1 08, 1 09) of preparing sub Image information (1 02) by preparing first pattern image information 
(1 02a) and second pattern image infomnation (1 02b) different from the first pattern image infonnation (102a). 
and by assigning the first and second pattern image information (102a, 102b) to the main image infonnation 



DOCID:<EP 1136947A2 I > 



10 



EP 1 136 947 A2 



10 



15 



20 



25 



30 



35 



40 



45 



50 



(101) such that the first pattern image information (102a) is assigned to an area corresponding binary image 
information representing a character or a symbol and such that the second pattern Image infonmation (102b) 
is assigned to a background area which is other than the area corresponding to the character or the symbol; 
a third step (110) of preparing synthetic image information (103) by synthesizing the sub image information 

(102) prepared in the second step (108, 109) with the main image information (101) prepared in the first step 
(106, 107), such that a synthesized state is not recognizable to the naked eye of the human being; and 

a fourth step (111) of recording the synthetic image information (103), prepared in the third step (110). on a 
recording medium (1 05) as a visible image. 

An image infomriation processing according to claim 7, characterized in that said second step (1 08, 1 09) prepares 
first pattern image inf omnation (1 02a) and second pattern image infomriation (1 02b). and said second pattern image 
information (1 02b) is obtained by rotating the first pattem image infomriation (1 02a) by a predetennlned angle. 
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PATTERN IMAGE INFORMATION 
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COLOR DIFFERENCE MODULATION RESULT 
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SUPERIMPOSITION PROCESSING RESULT {RED COMPONENTS) 
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